iiiiiwiiiiiiiEiiwiiieiiiii 

[1D EP 0 697793 A2 



(12) EUROPEAN PATENT APPLICATION 



(43) 


Date of publication: 
21.02.1996 Bulletin 199S/08 


(51) Int CI «: H04N 7/15, H04N 7/173 


(21) 


Application number: 95305420.2 






(22) 


Date of filing: 02.08.1995 






(84) 


Designated Contracting States: 
DE FR GB 


(72) 


Inventor: Wellner, Pierre David 
Mlddletown, New Jersey 07748 (US) 


(30) 
(71) 


Priority: 15.08.1994 US 290S63 

Applicant: AT&T Corp. 

New York, NY 10013-2412 (US) 


(74) 


Representative: 

Johnston, Kenneth Graham et al 
Woodford Green, Essex, IG8 OTU (GB) 



(54) Multimedia service access apparatus and method 



(57) The disclosed apparatus and method enables 
a user to control the selection of electronic multimedia 
services to be provided to the user by one or more serv- 
ers over a communication medium. The apparatus in- 
cludes a scanner means for reading marks on an object 
and for communicating a request signal, having an object 
code representing the read marks, to a user interface. 
The interface receives the request signal and transmits 
to the servers a request command including an interface 
identification code and the object code which is used to 
select the desired electronic multimedia service. The 
servers identify the selected electronic multimedia serv- 
ice using the object code. The interface then enables the 
selected electronic multimedia service transmitted from 
the servers to be received by the user's receiver. 
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Description 
Technical Field 

The invention relates generally to multimedia sys- 
tems and , more specifically, to a method and apparatus 
for controlling access to multimedia services. 

Background of the Invention 

Interactive electronic services, video-on-demand, 
and the "information superhighway" will provide access 
to thousands of movies, home shopping information, 
games, and other multimedia documents. A significant 
problem in using these systems is how to browse through 
the enormous choices to discover what is available, and 
to select items of interest. The conventional approaches 
to solving this problem are to use channel surfing, use 
advertisements on preview channels that act as entry 
points lo other movies, and use hierarchical menus thai 
users can navigate through with a remote control to 
make selections. These approaches do not scale up well 
to allow rapid browsing of the thousands of multimedia 
documents that will be available. 

Interactive television (1TV) systems will be able to 
present the user with information displayed on the 
screen, much as PC user interfaces do today. These ITV 
systems will be limited, however, by the low resolution of 
NTSC screens, and the low resolution of pointing devic- 
es that are usable from across a room. When it comes 
to making rapid selections from a large number of choic- 
es, ITV systems are awkward and slow to use. 



Summary of the Invention 

The invention provides an apparatus and method for 
enabling a userto control the selection of electronic serv- 
ices to be provided to the user by one or more servers 
over a communication medium. The apparatus includes 
a scanner means for reading marks on an object and for 
communicating a request signal, having an object code 
representing the read marks, to a user interface. The in- 
terface receives the request signal and transmits to the 
servers a request command including an interface iden- 
tification code and the object code to select the desired 
electronic service. The apparatus then enables the se- 
lected electronic service transmitted from the servers to 
be received by the user's receiver. In one illustrative em- 
bodiment, the servers are multimedia servers and the 
electronic service is a multimedia program. 

According to other aspects of the invention, the 
scanner means may communicate to the interface 
means over an infra-red link, a radio link, or over a wired 
connection. The scanner means may read marks such 
as bar codes, alphanumeric characters or Xerox glyphs. 
The interface means may be adapted to receive and 
transmit over a wire pair, cable, optical or radio commu- 
nication medium. 



RrlAf Description of the Drawing 



in the drawing, 
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FIG. 1 shows an illustrative system incorporating the 
present invention; 

FIG. 2 illustrates how the system might be used; 

FIG. 3 is an illustrative flow chart describing the 
operations of the present invention; and 

FIG. 4 shows an illustrative block diagram of a scan- 
ner pen. in accordance with the present invention. 

Detailed Description 

The present invention recognizes that people are 
very skilled at browsing through paper catalogs, maga- 
zines and books by flipping through the pages and glanc- 
ing at photographs and text. A collection of printed color 
photographs can be much easier and quicker to browse 
through than a set of NTSC images. Paper has a number 
of useful properties: it is easier and faster to read, mark, 
and manipulate; it is portable, familiar and easily distrib- 
uted. Many electronic systems attempt to replace paper, 
but it can be better for them to work with paper, exploiting 
its advantages to provide better access to multimedia in- 
formation. 

For example, U.S. patent number 4,947,028, issued 
to J. M. Gorog on June 8, 1993, describes an automated 
order and payment system which uses a ScanFone 
(trademark of U.S. Order). The ScanFone is a telephone 
with an attached credit card reader, a small alphanumer- 
ic display, and a bar-code scanner. Customers can use 
this ScanFone to pay bills and order merchandise from 
catalogs by scanning bar codes. This is an electronically 
supported, paper catalog home shopping application. It 
is phone-based, however, and does not enable the de- 
livery of multimedia signals over the established connec- 
tion to a user's multimedia terminal (e.g.. television). 

As shown in FIG. 1 , the system illustratively consists 
of one or more hand-held scanners or pens (11 ) that read 
marks (e.g., barcodes, alphanumeric characters, or Xer- 
ox glyphs) on the surface of an object. The object may 
be paper, plastic or other material. The object may also 
be mounted onto or be an integral part of an item as a 
means to identify that item. 

For example, it is contemplated that each photo- 
graph or advertisement in a newspaper, magazine, or 
catalog can be accompanied by a printed bar code or 
alphanumeric ID. In order to retrieve the associated mul- 
timedia document, a user scans the printed ID with the 
scanner or pen (11), and the movie, product information 
or game immediately starts to play. A variety of catalogs 
can be published (by the service provider or by third par- 
ties) catering to individual interests, e.g., old movies, hor- 
rorfilms, ormulti-user interactive games. Newspaper ad- 
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vertise merits, magazines, books and pamphlets can 
also include these printed marks just as they now use 
phone numbers. Home shopping retailers can provide 
specialty catalogs. Distance learning applications can 
put printed marks into text books. 

The scanner 1 1 communicates to the user interface 
unit 15 (e.g., a set-top box) through a cable, a wire pair 
(e.g., see scanner pen 11 and wire path 1 8), an infra-red 
link, or a radio link 12. 

An illustrative scanner pen 11 is shown in FIG. 4 to 
include a scanning head 401 to read marks on the object 
being scanned. The transceiver 402 communicates the 
unprocessed output from scanning head 401 over radio 
link 12. Optionally, the scanner pen .11 may include a 
controller/interpreter which decodes the unprocessed 
output from scanning head 401 into a more compact or 
standardized code or format for communication over ra- 
dio link 12. Switch 406 enables the user to turn on and 
turn off scanner pen 11 to conserve the battery 407. 

According to another aspect of the invention, an op- 
tional memory 404 may be provided to enable the user 
to scan in at one time and transmit at a later time. The 
later transmission can be controlled by a transmit control 
button 405. An optional display 408 may provide visual 
feedback tor communication to interface 1 5 or to display 
previously scanned marks in a human-readable format. 
A scan control button would enable a user to scroll 
through a plurality of previously scanned marks. 

The memory may also store a scanner pen identifi- 
cation (ID) code to, for example, distinguish signals from 
different scanner pens which communicate with inter- 
face 1 5. Scanner pen ID codes could be used to uniquely 
identify the user, if each user has his/her own scanner 
pen. In interface 15, the controller can then compare the 
scanner ID code against a previously stored authoriza- 
tion table to determine if the user's request is authorized. 
For example, user requests which involve a charge for 
a particular service may only be authorized for a parent's 
scanner pen but not for a child's scanner pen. If author- 
ized, the interface would include the scanner ID code as 
part of the scanner command sent to the servers 17. The 
scanner ID code may then be used by the servers 17 for 
the accounting or billing for services identified in the user 
request command. 

An optional audible transducer may also be provided 
in scanner pen 11 to provide audible feedback to the user 
that a successful scan of the object has been performed 
and/or that the interface 1 5 has received the transmis- 
sion from the scanner pen. Obviously, the interface 15 
could also cause the display unit, e.g., television 16, to 
display a feedback audio or visual message to the user. 

A scanner may be a separate pen or may be part of 
a remote control unit which provides remote control func- 
tions for the interface unit 15 and/or television 16. 

The interface unit includes means to provide audio 
and visual feedback to the user and means to transmit 
codes received from the scanner. The interface unit 15 
transmits over communication network 14 to the head- 
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end multimedia server 13. An optional telephone 19 
which connects to interface unit 15 may be used to es- 
tablish a connection to server 13. The interface unit 15 
may be incorporated as part of a VCR or television re- 

£ ceiver. In such an arrangement, the scanner 11 may in- 
clude VCR or television remote control functions. 

The communication network 1 4 may be provided by 
a cable TV company or telephone company or both and 
can use wire pair or coaxial cables, fiber optic cables, or 

to wireless technology. Moreover, the interface unit (also 
referred to as an interface) 15 can also interface to, or 
be integrated with, a telephone set, a cable TV unit at 
the user location. The interface unit 1 5 and television 16 
may together be implemented in a well-known manner 

is using, for example, a multimedia computer including a 
controller, memory, transmitter and receiver units, dis- 
play unit, etc., so as to implement the features described 
herein. 

The multimedia server 1 3 may alone or together with 

20 one or more other servers 17 have access to or store 
large numbers of movies, movie previews, games, or any 
of the other well-known information that is electrically ac- 
cessible by a user. The multimedia servers 1 3, 1 7 may 
provide a variety of multimedia services including prere- 

25 corded multimedia programs, instructional multimedia 
programs, and live multimedia programs. The multime- 
dia service may illustratively include prerecorded video 
movie previews-on-demand, videos, games, etc. The 
multimedia services may also be live or prerecorded en- 

30 tertainment or sporting events, etc. The instructional 
multimedia service may, illustratively, be a maintenance 
program for a particular product, an assembly program 
for assembling a product, an educational tutorial, etc. 
The live multimedia program may, illustratively, include 

35 a live connection toa person or computer which may pro- 
vide additional instructional information to the user. The 
user communicates with the person or interacts with the 
computer via telephone 19a. 

While the present invention will be described as us- 

40 jng multimedia servers 13, 17, it should be understood 
that the servers could, more generally, be used to pro- 
vide audio programs, video programs or electronic doc- 
uments to the user. Multimedia server 13 can handle 
service requests from thousands of customers at the 

45 same time. Once a user's input selection is processed, 
the server 13 sends multimedia data or programs down 
to the interface unit 15, which displays it on the user's 
television (TV) receiver 16. 

The servers 13 and 17 may illustratively be part of 

so one or more interactive television (ITV) networks 18, 
which may connect to communication network 14. The 
interactive television (ITV) network may, illustratively, be 
implemented as described in U.S. patent application Se- 
rial No. 07/g65,4g2 entitled "Interactive Television Con- 

55 verter" filed October 23, 1992; U.S. patent application 
Serial No. 07/997,985 entitled "Program Server For In- 
teractive Television System 0 filed December 28, 1992; 
U.S. patent application Serial No. 08/056,973 entitled 
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"Integrated Television Services System" filed May 3, 
1993; and U.S. patent application Serial No. 08/056,974 
entitled "System for Composing Multimedia Signals For 
interactive Television Services" filed May 3, 1 993; all as- 
signed to the assignee of the present invention and in- 
corporated herein by reference as if set forth in their en- 
tirety The ITV network 1 8 may be part of a larger global 
server network which may include videc-on-demand 
servers, interactive TV servers, videotelephone servers, 
broadcast TV servers, game servers, and user control 

panel servers. " 

Communication network 14 may include a national 
or international asynchronous transfer mode (ATM) net- 
work. In accordance with the present invention, a univer- 
sal identifier is used to uniquely address every accessi- 
ble electronic object on this network (sort ot like a super 
phone number). One way to use scanner pen (hereinaf- 
ter pen) 1 1 is in combination with marks 10 that represent 
a unique identifier code for electronic objects accessible 
on ITV network 18. These codes could work in a similar 
way as the well-known Universal Resource Locator 
(URL) identifiers in NCSA Mosaic (Internet client access 
software for World Wide Web), only they would be read 
from paper (instead of typed into an application) or invis- 
ibly linked to on-screen buttons. Because of the enor- 
mous number of objects that can be accessed, these 
codes need to be lar g e : and standard barcodes would 
become too large to be placed unobtrusively in paper 
publications. For this application, Xerox glyphs are more 
appropriate, because they can encode a large amount 
of data in a short space. 

Another possibility is for the scanner pen 11 to scan 
alphanumeric characters. These characters could spec- 
ify a unique identifier for a multimedia program, or they 
could be plain text that relates to some multimedia doc- 
uments stored in the ITV network 1 8. The servers 1 3, 1 7 
could match this text to keywords that describe stored 
documents on the network using well-known information 
retrieval techniques. This would enable the servers to se- 
lect the multimedia documents(s) that best match the 
keywords that the user scans, and ofler them for viewing. 
One example of howthis might be useful is for retrieving 
video clips of news or sports stories printed in newspa- 
pers and magazines. 

Depending on how much data is represented by the 
marks 10, it may be possible to access any electronic 
object on the ITV network 18 with a single swipe, or it 
may be necessary to make one or two swipes, first to 
identify a service and establish a connection to it, and 
then to identify a domain within that service, and finally 
to identify a specific electronic object controlled by that 
service. 

FIG. 2 pictorially illustrates how one embodiment ot 
the system might be used. In step 1, the user selects a 
film from a paper catalog and scans the identification 
(ID) marks next to the description of the film with the 
scanner pen 1 1 . The pen 1 1 transmits scanned informa- 
tion from the paper to the interface unit 15 (also referred 



to as an interface). In step 2, the interlace 15 interprets 
the information sent by the pen 11 and communicates 
with the multimedia server to request the movie that the 
user has selected. In step 3, the server transmits the film 
5 which begins to play on the TV monitor. Desirably, there 
should be almost no time lag between steps 2 and 3; but 
if there is a delay, then the multimedia server would out- 
put a message to the TV screen to indicate that the film 
is in the process of being retrieved. 
10 Using this technique, a user may quickly browse 
through and preview dozens of movies or stored TV pro- 
grams in a few minutes. To actually purchase a movie, 
the system may prompt the user, at the conclusion of a 
preview (or during a preview), and ask the user to signal 
is his/her confirmation of the purchase by using one of the 
control buttons 405. Alternatively, predefined control 
marks, shown by 17 in FIG. 2, may be used to control 
various functions ot the interface 15 and television 16. 
Illustratively, these control functions may include the 
so standard type VCR control functions (start, stop, pause, 
etc ) as well as ordering functions (e.g., using an •order- 
mark). As shown in FIG. 2 % a user can scan a predefined 
"order" mark to place his/her purchase order at any time 
during the preview. These predefined marks can be lo- 
ss cated on the same object (catalog, card, etc.).or on one 
or more menu cards. 

FIG. 3 shows an illustrative flow chart of the steps 
involved in operating the present invention. In step 301 . 
communication is established between the interface 15 
30 and the server 1 3. This could be done by making a tele- 
phone call using telephone 19a or, if there is a full-time 
connection set up. by default, then only a few data pack- 
ets need to be addressed from interface 15 to an appro- 
priate server 13 via network 14. The initial selection of 
as server 13 could be made using pen 11 to tell the interface 
15 what server to address. In step 302, the user swipes 
the paper with the pen 11, which senses marks on the 
paper in step 302a, the pen 11 may optionally store the 
mark information for later transmission to interface 15. 
40 in step 303, as previously described, these marks may 
be interpreted within the pen 11 before the information 
is transmitted to interface 1 5 or, to reduce the cost of the 
pen the pen 11 may send raw scanning information to 
the interface 1 5 for processing. In step 304, interface 1 5 
45 interprets the received information and may provide au- 
dio or visual feedback to the user. Interface 15 may also 
provide feedback to an audible transducer of pen 11 to 
indicate that it has received the scanning information. In 
step 305, the interface 15 communicates interpreted 
so scanned data to a server via network 1 4, along with in- 
formation that identifies itself and, optionally, pen 11. In 
step 306, the server 1 3 communicates with other servers 
17 (e g M billing servers, name servers, object database 
servers), in step 307, one of these servers begins to 
55 transmit electronic information to interface 1 5. The steps 
303 through 307 may involve bidirectional communica- 
tions In the case of a movie, this information might be 
in the form of an MPEG data stream, which must be de- 
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compressed by interface 15, in step 308, before it can 
be displayed on the TV (or multimedia) receiver 16. In 
step 309, if there are additional user/server interactions 
performed, e.g., the ordering of a movie once a preview 
has been seen, control is returned 1o step 302. in step 
302, the user would swipe across predesignated control 
function marks (e.g. % an "order" mark) to perform the or- 
dering function. These control functions can be initiated 
at any time by a user. In step 309, if no additional us- 
er/server interaction is necessary, then step 31 0 is per- 
formed. In step 310, communication is terminated be- 
tween the server and the user in accordance with the 
user's desires, the end of the session, or other prede- 
fined criteria. 

Other possible users of the present invention are 
identified below. Each of these applications makes use 
of the previously described basic hardware and the same 
basic process. The differences are in what information 
is transmitted, and what the codes are printed on. 

Product assembly and service instructions 

A customer receives a lawn tractor, or complex piece 
of computer equipment, and each piece in the box is la- 
beled with a bar code. When the customer scans these 
codes, video instructions instantly play to demonstrate 
how the part needs to be installed or serviced. It is no 
longer necessary to look through printed manuals to dis- 
cover what a part is called and what to do with it. The 
objects themselves lead you through the process. 

News magazines and newspaper access to TV 
footage 

As subscribers read through a newspaper or maga- 
zine, they may be interested in seeing associated video 
footage. While the sports pages (e.g., Sports Illustrat- 
ed), key events could be instantly recalled and played 
on demand, e.g., the moment an Olympic skier falls, the 
winning goal, etc. News stories can allow readers to in- 
stantly play interviews, sound bites, and crucial video 
footage of historical or current events. 

Paper-based advertising linked to on-demand 
multimedia ads 

Many of today's 800-n umber calls originate with a 
customer reading a paper advertisement in a newspaper 
or magazine or in direct mail ads. Multimedia ads may 
be the same. According to the present invention, people 
could instantly access multimedia presentations by swip- 
ing bar codes in the ads that catch their attention. These 
ads could lead to interactions with the company and to 
ordering. Merely the information that a person browsed 
through in the ad could be valuable for the company's 
future marketing efforts. 



Courses and textbooks 

Multimedia lectures could be tied to paper-based 
textbooks. Extensive reading is easier to do on paper, 

s but animated video explanations and demonstrations 
are much more effective for some purposes. The two can 
be tied together by placing bar codes in the textbook that 
allow students to view parts of a lecture or specific dem- 
onstrations they are interested in. These bar codes could 

10 also link the textbook to live discussion groups with other 
students or to line interactions with professors and tutors. 

What has been described is merely illustrative of the 
application of the principles of the present invention. Oth- 
er arrangements and methods can be implemented by 

is those skilled in the art without departing from the spirit 
and scope of the present invention. 



Claims 

20 

1. Apparatus for use with a multimedia server for ena- 
bling a user to control the selection of an electronic 
multimedia service to be provided to the user by the 
multimedia server over a communication medium, 

25 CHARACTERIZED BY 

scanner means (11), operable by a user, for 
reading marks on an object and for communicating 
to a user interface (15) a request signal including an 
object code representing the read marks and 

30 said interface for interfacing the scanner 

means and a user display terminal (16) to the com- 
munication medium, including 

receiver means (304) for receiving the request 
signal from said scanner means, 

35 transmitter means (305) for transmitting over 

the communication medium to the server a request 
command including an interface identification code 
and the object code to select a multimedia service 
available from the server, and 

40 means for enabling (308) a received selected 

multimedia service from the server to be outputted 
to the display terminal. 

2. The apparatus of claim 1 

45 CHARACTERIZED IN THAT 

said scanner means reads marks off of a paper 
object. 

3. The apparatus of claim 1 

so FURTHER CHARACTERIZED IN THAT 

said interface provides visual display feedback 
to a user in response to reception of said request 
signal. 

ss 4. The apparatus of claim 1 

FURTHER CHARACTERIZED IN THAT 
said scanner means reads one or more of a 
group of marks including at least alphanumeric char- 



5 



BNSDOCID: <EP 0697793A2_L> 



EP 0 697 793 A2 



10 



acters, Xerox glyphs, and bar codes. 

The apparatus of claim 1 

FURTHER CHARACTERIZED IN THAT 
said scanner means includes 
means for storing the read marks and 
means, operable by a user, for controlling the 

communication of the object code to said interface. 

The apparatus of claim 1 

FURTHER CHARACTERIZED IN THAT 
said scanner means includes a scanner iden- 
tification code in the request signal communicated 
to said interface. 
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The apparatus of claim 1 4 

FURTHER CHARACTERIZED IN THAT 
said interface includes the scanner identifica- 
tion code in the request command transmitted to the 

20 

servers. 

A method for providing an electronic multimedia 
service to a user, 

CHARACTERIZED BY the steps of 
establishing (301 ) a bidirectional communica- 25 
tion connection between a user terminal and a mul- 
timedia server location, said connection from said 
multimedia server to said user being capable of car- 
rying a video signal, 

scanning (302) marks on paper to identify a 30 
multimedia service selected by a user. 

converting (304) the scanned marks into a 
request command including a first code identifying 
at least one video preview and a second code iden- 
tifying a user's terminal, 

communicating (305) the request command to 
said multimedia server location over the established 
connection, said multimedia server location contain- 
ing a plurality of video previews, 

selecting (306), at the multimedia server, a 40 
multimedia service using the received request com- 
mand, and 

transmitting(307) a multimedia signal associ- 
ated with the selected multimedia service over the 
connection from the multimedia server location for 45 
output at the user's terminal. 

9. A method for providing a video-pre- 
views-on-demand service to a user, 

CHARACTERIZED BY the steps of 50 

establishing (301) a bidirectional communica- 
tion connection between a user terminal and a mul- 
timedia server, 

scanning (302) marks identifying a video pre- 
view scanned from a catalog at a user's terminal, 55 

converting (304) the scanned marks into a 
request command including a first code identifying 
at least one video preview and a second code iden- 



tifying the user's terminal, 

communicating (305) the request command to 
said multimedia server over the established connec- 
tion, 4 , 

selecting (306), at the multimedia server, the 
video preview using the received request command, 

**** transmitting (307) a video signal associated 
with the selected video preview over the connection 
from the multimedia server for output at the user's 
terminal. 

10. A method for providing an instruction-video-pro- 
gram-on-demand service to a user, 

CHARACTERIZED BY the steps of 
providing a multimedia server (18) having a 
plurality of video programs accessible by a user in 
response to a request command received trom the 
user, 

establishing (301) a communication connec- 
tion between a user terminal and a multimedia 
server location, 

scanning (302) marks identifying an object at 

the user's terminal, 

converting (304) the scanned marks into a 
request command including a first code identifying 
the object and a second code identifying the user's 
location, 

communicating (305) the request command to 
said multimedia server location over the established 
connection, 

selecting (306). at the multimedia server loca- 
tion, one or more multimedia services, associated 
with the identified object, selected from a group 
including at least a prestored instructional multime- 
dia program, a live multimedia connection to a per- 
son, and a live multimedia connection to a computer 
workstation, and 

transmitting (307) a multimedia signal associ- 
ated with the selected multimedia service over the 
established connection from the multimedia server 
location for output at the user's terminal. 

11 Apparatus enabling a user to control the selection of 
electronic multimedia services to be provided to the 
user by a multimedia server over a communication 

medium, 

CHARACTERIZED BY 
a multimedia server (18) including a plurality 
of multimedia services, each multimedia service 
being selectable, in response to a request command 
from a user, for transmission over the communica- 
tion medium to the user, and 
a user terminal including 
scanner means (11), operable by a user, for 
reading marks on an object and for communicating 
to a user interface (1 5) a request signal including an 
object code representing the read marks, 
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a display apparatus (16) for outputting a 
selected multimedia service received over the com- 
munication medium, and * 

said interlace for interfacing the scanner 
means and the display apparatus to the communi- s 
cation medium including 

receiver means (304) for receiving the request 
signal 1rom said scanner means, 

transmitter means (305) for transmitting over 
the communication medium to the server a request 10 
command including an interface identification code 
and the object code to select a multimedia program 
available Irom the server, and 

means for enabling (308) a received selected 
multimedia service transmitted from the server to be is 
outputted to the display apparatus. 
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